Reduction of Dilute Ising Spin Glasses 
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The recently proposed reduction method for diluted spin glasses is investigated in depth. In par- 
ticular, the Edwards- Anderson model with ± J and Gaussian bond disorder on hyper-cubic lattices 
in d = 2, 3, and 4 is studied for a range of bond dilutions. The results demonstrate the effectiveness 
of using bond dilution to elucidate low-temperature properties of Ising spin glasses, and provide a 
starting point to enhance the methods used in reduction. Based on that, a new greedy heuristic call 
"Dominant Bond Reduction" is introduced and explored. 

PACS numbers: 02.60.Pn, 05.50.+q, 75.10.Nr. 



I. INTRODUCTION 

Despite more than three decades of intensive research, 
many properties of spin glassesii^ii^ii^, especially in finite 
dimensions, are still not well understood. The most sim- 
ple model is the Edwards- Anderson model (EA)^, 



<i,'J> 



(1) 



with Ising spins = ±1 arranged on a finite-dimensional 
lattice with nearest- neighbor bonds Ji j , randomly drawn 
from a distribution P{J) of zero mean and unit variance. 

In Refs. [1011, it was proposed to study the EA in 
Eq. ([T|) on bond-diluted lattices at T = to obtain 
more accurate scaling behavior for low-tcmpcrature ex- 
citations. There, it is shown how to remove iterativcly 
low-connected spins from the lattice and alter the inter- 
actions, i. e., to reduce the system, in such a way that the 
ground-state energy of the reduced system is the same as 
the original system. In this way often much larger lat- 
tice sizes L can be simulated compared to undiluted ones 
and, in combination with finite-size scaling, enhanced 
scaling regimes are achieved. With these methods, for 
instance, we have solved spin glasses exactly at the bond- 
percolation threshold Pc, the edge of the glassy regime, 
in d = 2, . . . , 7 by reducing a large number of systems 
with up to 10® spins^. 

There is, of course, a long history of studying spin 
systems on dilute lattices, including spin glasses, going 
back to Ref. H itself; see for example Refs . llOii 1 1. 1 2., 1 3„. 14 
Coniglio and co-workers have proposed to map the en- 
semble of critical Ising (or Potts) spin model a^^i^^ onto 
percolating clusters, based on the ideas of Fortuin and 
Kasteleyrtii, to treat ferromagnetioi^ and spin glass phe- 
nomena— i^S. Our approach here is based on transfor- 
mations in the Hamiltonian of an Ising spin system that 
are exact for each instance. The price paid is that these 
transformations reducing the Hamiltonian only apply at 
T = 0. Extending our earlier work on the Migdal- 
Kadanoff approximation^, Ref. [2l| very recently included 
infinitesimal temperature corrections. Their method is 
limited to discrete bonds and a subset of the rules we 
discuss here. As we can merely consider T = 0, we are 



unfortunately not sensitive to the novel transition seen 
by Ref. [2l] that is said to emerge only at non-zero tem- 
peratures. 

Our approach, combined with the highly efficient "Ex- 
tremal Optimization" (EO) heuristi o^^i^^ , have lead to a 
comprehensive characterization of low-temperature exci- 
tations in spin glasses in low dimensions (up to d = 7)^. 
These results allow for a direct comparison with mean- 
field predictions^^, and have recently motivated a re- 
assessment of fundamental scaling relation a^^i^^ . This 
work has also inspired the use of dilution for more 
effective Monte Carlo simulations of disordered sys- 
tems2i^i29^. 

Here we study the connection between lattice-topology 
and the reduction method. In particular, we explore the 
effectiveness of each of the reduction rules as a function of 
bond dilution. The results provides the reader with an 
opportunity to evaluate in more detail the conclusions 
drawn in previous paper a^'^'^^i"^^'^^ , and might suggest 
possible extensions of these rules for improved effective- 
ness. As an example of a concrete application, we intro- 
duce and evaluate "Dominant Bond Reduction" (DBR), 
a new heuristic which provides a greedy, almost linear al- 
gorithm to obtain approximate spin-glass ground states 
on average with bounded relative error for increasing sys- 
tem sizes. 

This paper is structured as follows. In the next Section, 
we will introduce the reduction method and its rules. In 
Sec. mil we display and discuss our numerical investiga- 
tion of the reduction rules. In Sec. llVi we discuss our 
simulation results for DBR, followed by some concluding 
remarks in Sec. [V] In the Appendix, a generalized de- 
scription of the reduction method is provided, with some 
speculations on its applicability. 



II. REDUCTION METHOD 

To exploit the advantages of spin glasses on a bond- 
diluted lattice, we can often reduce the number of relevant 
degrees of freedom substantially before a call to an opti- 
mization algorithm becomes necessary. Such a reduction, 
in particular of low-connected spins, leads to a smaller, 
compact remainder graph, bare of trivially fluctuating 
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FIG. 1: "Star-triangle" relation to reduce a three-connected 
spin a;o. The new bonds on the right are obtained in Eq. @. 





variables, which is easier to optimize. These reductions 
are very similar to a procedure known as k-core decompo- 
sition in graph theory, which is often applied to analyze 
hard combinatorial or real-world problems2^i24i^. Fur- 
thermore, rules of this sort have also been used to study 
planar— and 3d resistor networks^!. 

Here, we focus exclusively on the reduction rules for 
the ground-state energy (i. e., T = 0); a subset of these 
rules also permit the exact determination of the entropy 
and overlap^ at T ~ 0. These rules apply to general 
Ising spin glass Hamiltonians as in Eq. ([1]) with any bond 
distribution P{J), discrete or continuous, on arbitrary 
sparse graphs. 

The reductions affect both spins and bonds, eliminat- 
ing recursively all zero-, one-, two-, and three-connected 
spins. These rules are supplemented here with one that is 
not topological but concerns bond values directly, which 
is especially effective for broad, continuous bond distri- 
butions, like Gaussian or power-law bonds. The addition 
of more elaborate rules that depend of suitably chosen 
bond distributions is conceivable, the universality of the 
underlying physics permitting. These operations elim- 
inate and add terms to the expression for the Hamil- 
tonian in Eq. ([!]), but leave it form-invariant. Again, 
loosening this requirement may lead to an even more ef- 
ficient procedure for certain problems, although it should 
be understood that an unrestricted reduction in general 
leads to an exponential growth in the number and form 
of the newly created terms, involving all combinations 
of p-spin interactions (see the Appendix). Offsets in the 
energy along the way are accounted for by a variable iJo, 
which is exact for a ground-state configuration. The rules 
discussed here are as follows: 

Rule I: An isolated spin can be ignored entirely. 

Rule II: A one-connected spin i can be eliminated, 
since its state can always be chosen in accordance with its 
neighboring spin j to satisfy the bond Ji j. For its ener- 
getically most favorable state we adjust Ho := Ho — | J; j | 
and eliminate the term —Jij Xi Xj from H. 

Rule III: A double bond, J-'^^ and J-^^ , between two 
spins i and j can be combined to a single bond by setting 



J^. 



J-j +J-'^j or be eliminated entirely, if the resulting 



bond vanishes. This operation is very useful to lower the 
connectivity of i and j at least by one. (For an example, 
see Fig. ^ 

Rule IV: For a two-connected spin i, rewrite the two 



FIG. 2: Illustration of Rule VI for "strong" bonds. Left, 
the local topology of a graph is shown for two spins, xq and 
xi, connected by a bond Jo,i (thick line). If Jo,i > (resp. 
Jo,i < 0) satisfies Eq. (O, 2:0 and xi must align (resp. anti- 
align) in the ground state and xo can be removed. Right, the 
remainder graph is shown after the removal. The other bonds 
emanating from xq (dashed lines) are now directly connected 
to x\ (with a sign change, if Jo,i < 0). This procedure may 
lead to a double bond [Rule III), as shown here, if xi was 
already connected to a neighbor of xo before. 



terms pertaining to Xi in Eq. ^ as 

Xi{Ji,lXi + Ji^2X2) < \Ji,lXl + Ji^2X2\ 

= Ju2XiX2 + AH, (2) 

where 

Jl,2 = -^i\Ji,l + Ji,2\ ~ \Ji,l — Ji,2\) , 



AH 



2 + Ji,2\ 



\Ji,l " Ji, 



(3) 



leaving the graph with a new bond J1.2 between spin 1 
and 2, and acquiring an offset Hg := Ho — AH. In the 
ground state, the bound in Eq. ([2]) becomes an equality. 

Rule V: A three-connected spin i can be reduced via a 
"star-triangle" relation, as depicted in Fig.[TJ We rewrite 
the three terms pertaining to Xi in Eq. ([1]) as: 

Ji,l Xi Xi + Ji^2 Xt X2 + Jj,3 Xt X3 
< \Ji.lXl + Ji,2X2 + Ji.sxsl (4) 
= Jl,2 Xi X2 + Jl,3 Xi X3 + J2,3 X2 X3 + AH, 

where 

Ji,2 = -A - S + C + D, Ji^3 = A - B + C - D, 
J2,3 = -A + B + C - D, AH = A + B + C + D, 

^ = i I'^iA ^ Ji,2 + Ji,^\ 1 ^ ~ 3 \ ^ Ji,2 — Ji,^\ , 
^ ~ J l^^'.l + "^^2 + Ji.sl , ^ — J \ + Ji,2 ^ Ji,3\ ■ 

As before, in the ground state, the bound in Eq. ([4]) be- 
comes an equality. 

Rule VI: A spin i (of any connectivity) for which the 
absolute weight \Ji,j'\ of one bond to a spin j' is larger 
than the absolute sum of all its other bond-weights to 
neighboring spins j ^ j' , i. e. 

i4/i>Ei"^^j-i' (5) 
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FIG. 3: Plot of the efRciency of the reduction steps as a function of bond density p in rf = 2 (left column), d — 3 (middle 
column), and d = 4 (right column) for ±J bonds (top row), Gaussian bonds without super-bond reduction SB according to 
Rule VI (middle row), and Gaussian bonds with SB (bottom row). All efficiencies quickly become independent of system size 
L, with closer-spaced curves corresponding to larger sizes. Rule VI, which is useful only for continuous bonds, does not effect 
other rules much, but adds up to 10% in reduction even at p = 1, with decreasing effect for larger d. 



bond Jiji must be satisfied in any ground state. Then, 
spin i is determined in the ground state by spin j' and 
it, as well as this "super-bond" Jij' , can be eliminated 
accordingly, as depicted in Fig. [21 Here, we obtain Hq := 
Ha — \Ji,j'\- AH other bonds connected to i are simply 
reconnected with j', but with reversed sign, if Jiji < 0. 

This procedure is costly, and hence best applied af- 
ter the other rules are exhausted. But it can be highly 
effective for very widely distributed bonds. In particu- 
lar, since neighboring spins may reduce in connectivity 
and become susceptible to the previous rules again, an 
avalanche of further reductions may ensue, see Fig. [21 

After a recursive application of these rules, the origi- 
nal lattice or graph is either completely reduced (which 
is almost always the case below or near pc), in which 
case Ho provides the exact ground state energy already. 



or we are left with a reduced, compact graph in which 
no spin has less than four connections, from which one 
could obtain the ground state with some optimization 
procedure, as described in Refs. iim. Reducing even 
higher-connected spins would lead to new (hyper-)bonds 
between more than two spins, unlike Eq. ([T]), as discussed 
in the Appendix. 



III. NUMERICAL SIMULATIONS 

In our simulations we have studied EA spin glasses on 
hyper-cubic lattices over a range of sizes L in dimensions 
d ~ 2, 3, and 4 at various bond fractions p for ± J bonds 
and Gaussian bonds. Similar studies could as well have 
been done on an arbitrary family of sparse graphs, with- 
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TABLE I: List of the range of system sizes L chosen for each 
dimension d in Figs. OHl 



d 



10, 20, . 
5, 10,. 
3,4,... 



. . , 100 
..,20 
10, 15 



out restriction. Wc have applied the rules described in 
Sec. In] recursively, until no further reductions were pos- 
sible. We have calculated a number of aspects of this 
reduction, such as the number of spins in the remainder 
graph relative to the original lattice, the average connec- 
tivity in the remainder graph, and the fraction of systems 
that is completely reducible (without remainder), all as 
a function of bond-density p. Similarly, we have counted 
along the way how many times each of the reduction rules 
has been applied for graphs of a certain size L and bond 
fraction p. The system sizes used in each figure of this 
section are listed in Tab. |T] for each dimension. 

In Figs. [3] we have plotted the efficiency of the reduc- 
tion step for one-connected spins [Rule II above, labeled 
Rl here), two-connected spins [Rule IV, R2 here), three- 
connected spins (Rule V, R3), double bond elimination 
[Rule III, Rd), and super-bonds {Rule VI, SB) as a func- 
tion of p for dimensions d = 2, 3, and 4. Efficiency is 
defined here as the number of calls to that step in a run 
relative to the original number of spins N = L'^ in the 
original lattice. We observe that each of the reduction 
rules reaches a peak for increasing bond densities, in or- 
der of Rl, R2, R3, and SB. Rd, the elimination of 
double bonds, actually does not itself involve the reduc- 
tion of a spin, and its behavior is more varied. The rise 
to that peak is very dependent on the recursive appli- 
cation of the set of rules, exhausting lower rules (which 
are computationally less costly) first before applying a 
higher rule. For instance, at least everything that is re- 
ducible by Rl and R2 could also have been reduced with 
SB. Thus, the further to the right a rule peaks, the more 
powerful it is, and its decline signals significant changes 
in the structure of the graph. The peak of Rl near pc 
(marked by a vertical line in each plot) is a consequence 
of the well-known fact that a percolating graph is pre- 
dominantly one-connected, i. c, Pc ~ l/(2d) such that 
the connectivity is ac = 2dpc ~ 1 for d ~* oo. The values 
for the bond-percolation thresholds on hyper-cubic lat- 
tices are Pc = 1/2 in d = 2, pc ~ 0.2488 in d = 3, and 
Pc « 0.1601 in d = 4. These thresholds are indicated by 
vertical lines in each plot. 

The additional use of SB does not seem to affect the 
other rules much (except for Rd) . While it does not seem 
to trigger avalanches of activity for lower rules (except 
just above Pc), it in itself often leads to nearly 10% further 
reduction at larger p. 

In Figs. |3]we have plotted, as a function of bond den- 
sity p, the fraction of instances that result in a remain- 



der graph after a complete exhaustion of the reduction 
rules. We note that below and near the bond-percolation 
threshold pc in each dimension, almost all graphs are 
completely reducible. This implies that the optimization 
of their energy can be done in polynomial time. Physi- 
cally, this means that there can not be an ordered, glassy 
state even at T = below pc, of course. For increasing 
system size, a sharp transition emerges such that almost 
every graph has some non-empty remainder (of unspec- 
ified size) above that transition. In case of the discrete 
± J bonds this transition appears to be related with pre- 
sumed onset of spin-glass order at p ~ p* > Pc, as dis- 
cussed in Refs.HQ. For Gaussian bonds, p* ~ Pc, and the 
transition appears to be centered close to that. Asymp- 
totically, the use of SB seems to push the transition just 
above pc, whereas it seems to locate somewhat below 
without SB. 

In Figs. [5] wc have plotted the average size of the re- 
mainder graph (empty or not) as a function of bond den- 
sity p. Including empty remainder graphs in the weight 
of the average is important, of course, and explains the 
values below unity at low p. The pivot point indicates 
a well-defined transition point closely related to a 3-core 
percolation transitio n^'^i'^^'^^ above Pc, as our rules reduce 
at least all vertices of degree less than 4. The correspon- 
dence is not exact, as cooperative effects between bond 
weights (such as Rule III) or superbonds {Rule VI) dis- 
tort the pure case. Predictably, for p — > 1 the graphs re- 
mains unaltered, except maybe for a few spins reducible 
by SB at lower d. 

In Figs. [6] we have plotted the average connectivity 
{a) of any non-empty remainder graph as a function of 
bond density p. By virtue of the reduction rules, it is 
{a) > 4. The data is very noisy below pc, since almost 
all remainders are empty there. These connectivities will 
eventually approach 2d for p — > 1, except when SB is 
included. There is a strong effect due to SB also right 
above the threshold Pc, where Rule VI leads to an in- 
creasingly sharper maximum with size and dimension, as 
Eq. (O is more likely satisfied there. 



IV. DOMINANT BOND REDUCTION 
HEURISTIC 

The Rule VI in Sec. [IT] is based on the following obser- 
vation: If the absolute weight \Ji.j'\ of one bond incident 
on spin Xi from a neighboring spin Xj' exceeds the abso- 
lute sum of all its other — 1 bond- weights with adjacent 
spins, i. e. if by Eq. ^ 



E 



J, 



<1, 



(6) 



bond Jij' must be satisfied in any ground state. In the 
exact reduction procedure, as applied in Sec. IIIIl such a 
dominant bond is used to eliminate it and the spin Xi 
from the problem. 
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FIG. 4: Plot of the probability to obtain any non-empty remainder graph after a complete exhaustion of the reduction rules as 
a function of bond density p in c? = 2 (left column), d = 3 (middle column), and d = 4 (right column) for ±J bonds (top row), 
Gaussian bonds without super-bond reduction SB according to Rule VI (middle row) , and Gaussian bonds with SB (bottom 
row). The sequence of graphs in each plot steepen for increasing system size L from right to left. There is a strong dependence 
on L, and it appears that the probabilities converge to a — 1 step function at or near the bond percolation threshold (indicated 
by a vertical line). With super-bond reduction. Rule VI, graphs are far more reducible even significantly above the threshold, 
at least at any finite size. 



Here, we consider relaxing that constraint to assess 
the quality of approximate results that can be obtained 
with a heuristic approach. We assume that even if 
ri > 1 in Eq. ([6|), any almost-dominant bond on a 
spin Xi is more likely satisfied in a ground state. This 
suggest a fast, greedy heuristic: Find the spin Xi with 
Ti = fmin = wzni<j<Ar{rj} in an instance and eliminate 
it and its strongest bond as in Rule VI. This step can 
be repeated until any number of the heaviest bonds have 
been removed to treat the remainder with an optimiza- 
tion heuristic like EO, or even until the entire lattice is 
reduced. The latter heuristic wc call "dominant bond 
reduction" (DBR). 

Like Rule VI itself, DBR is not useful for homoge- 
neous bond distributions like ±J, where all bonds have 



the same absolute weight \J\ = 1 (at least initially). But 
it may be very effective for continuous bond distributions 
on dilute lattices with low average connectivity (a), as 
we have shown in Sec. IIIII We can further exploit the 
universality of bond distributions and utilize broadly dis- 
tributed bonds^i^, such as a power law, P(J) ^ \J\~^ 
for |J| — > oo, as long as P{J) has zero mean and finite 
width. In fact, such a greedy procedure has already been 
described for extremely widely separated bonds (each 
bond is larger in weight that the sum of all smaller ones) , 
where it becomes exact^i^: the problem is no longer 
NP-hard. For the power-law bonds, we expect that there 
is a transition in the behavior of this procedure at some 
finite value of 7c. Hence, we may find a "sweet spot": a 
sufficiently broad distribution on a sufficiently dilute lat- 




0.5 0.6 0.7 0.25 0.3 0.35 0.15 0.2 0.25 0.3 

P P P 

FIG. 5: Plot of the average (fractional) size of the remainder graph (empty or not) as a function of bond density p in d — 2 
(left column), d = 3 (middle column), and d = 4 (right column) for ±J bonds (top row), Gaussian bonds without super-bond 
reduction SB according to Rule VI (middle row), and Gaussian bonds with SB (bottom row). Super-bond reduction with 
Rule VI lowers the remainder size near the threshold by about an order of magnitude, but with diminishing effects for larger 
p. The sequence of graphs in each plot steepen for increasing system size L. 



ticc for efficient DBR on very large lattices, while p just 
above pc and 7 just above 7c ensure the EA universality 
class in any dimension. 

Frustration leaves many bonds violated in the ground 
state, obviously, and our recursive elimination proce- 
dure accounts for that through compounding bonds in 
Rule III, as described also in Fig. [51 In a simple bench- 
mark, shown in Fig. [71 we found that DBR obtains 
an approximate ground state energy density of {e)^ ~ 
-1.308(1) for the undiluted EA, in d = 2 at TV = 100^, 
only 0.5% above (e)oo = —1.31479(2), the best-known 
result^, and (e)w = -1.631(1) in d = 3 at TV = 20^, 
4% above (e)oo = —1.700(1)^. Computational costs are 
trivial, 0{d N In N), but our implementation is limited 
to < 10^ by a data structure problem: repeated appli- 
cation of Rule VI leads to a few highly connected spins 



with hundreds of neighbors. Of course, to calculate prop- 
erties of low-T excitations, even a systematic error of 4% 
would be unacceptably large, and our naive DBR algo- 
rithm will have to be developed into a meta-heuristic, 
again combining reduction and EO. 

To explore the effect of broadly distributed bonds, we 
have compared DBR for one undiluted cubic lattice of 
size N = 20^ with Gaussian and power-law bonds at 
7 = 1.5. In Fig. [H we show the value of the (smallest) 
Ti = fmin hi Eq. ^ of the currently reduced spin Xi 
during one run of DBR. Initially, for all rmin < 1 , DBR 
is exact, which persists much longer for power-law bonds. 
Even when Tmin > 1 , the size of r„ii„ is typically smaller 
for power-law bonds. Considering that DBR's systematic 
error is only 4% for Gaussian bonds, we project that 
power-law bonds should be even more successful. We 
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FIG. 6: Plot of the average connectivity {a) of any non-empty remainder graph as a function of bond density p in d = 2 
(left column), d — 3 (middle column), and d = 4 (right column) for ±J bonds (top row), Gaussian bonds without super- 
bond reduction SB according to Rule VI (middle row), and Gaussian bonds with SB (bottom row). The dramatic effect of 
implementing Rule VI becomes apparent near the percolation threshold, especially for increasing d. The sequence of graphs in 
each plot steepen for increasing system size L. 



expect to conduct more extensive tests for varying 7 and 
increasing A^. which will require a significantly revised 
data structure compared to the one used in these studies. 



V. CONCLUSIONS 

Our results validate the effectiveness of the recently 
proposed reduction scheme to determine the stiffness ex- 
ponent y^, leaving remainder graphs that are a small 
fraction (typically « 1 — 10%) of the size of the origi- 
nal problem in the interesting regime just above Pc- Note 
that the fact that reduction works well in two-dimensions, 
where Tc = holds, does not imply definitively that it 
should work for d > 2. Nevertheless, since the local in- 
terconnections between spins (i e., graph vertices) near 



and just above pc in d — 2 and higher dimensions is 
similar, justifies that the reduction scheme is applicable 
also for higher dimcnsions^i^i, or even sparse random 
graph S"^ ' ''?" -, where no exact ground-state algorithms are 
available. As the general discussion and the speculative 
inferences in the Appendix suggest, it may be possible 
to extend the methods discussed here for any particular 
graph topology or bond distribution at hand. We have 
also presented evidence that a heuristic approach, based 
purely on the bond reductions introduced in Sec. [TTl 
provides a fast algorithm to obtain approximate ground 
states, with the potential to handle even large or undi- 
luted systems within bounded error. 
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FIG. 7: Extrapolation plot of approximate ground-state en- 
ergy densities (e) — {E) / for the two-dimensional EA in 
Eq. IT} as a function of 1/ . Each data point is the average 
over 10* random instances. The results for the DBR heuris- 
tic (circles) discussed in the text extrapolate to within 0.5% 
of the best-known prediction by Campbell, Hartmann, and 
Katzgraber (CHK)^, marked by the horizontal line. Shown 
are also results obtained with the EO heuristic (squares) 
which reproduces CHK within errors, and a simple alterna- 
tive to DBR we call Least Bond Reduction (LBR, triangles). 
LBR also applies Rule VI, but to the spin with the weakest 
total bond-weight, i. e., where the sum of all absolute weights 
of incident bonds is minimal. Both, DBR and LBR, are much 
faster than EO. LBR is marginally simpler than DBR and 
avoids the creation of highly-connected spins. 
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FIG. 8: Plot of r-„i„ during a run of DBR on a iV = 20^ 
lattice with Gaussian (top) and power-law bonds at 7 = 1.5 
(bottom). 
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Appendix 

In general, a spin glass Hamiltonian H, such as the 
one in Eq. (jT]), consists of the sum (in the negative) of 
a number of terms Jii,...,ipXi^ . . . Xi^, each representing a 
(hyper-)bond of weight J between p spins xi € { — 1, +!}• 
The number of connected spins p may vary between 
terms, although p = 2 for all terms in Eq. The bonds 
J are quenched variables drawn from an arbitrary distri- 
bution, discrete or continuous. A particular instance of 
the spin glass Hamiltonian is specified by the values of 
these quenched variables. 

A ground state minimizes H, thus we want to maxi- 
mize as many terms as possible in —H. Each spin, say 
xq, appears in a number of such terms, connecting it to 
a total of q other spins. In general, there are 2' possible 
terms, and we can eliminate xq = ±1 by 

JqXq + JlXlXo -I- . . . + JqXqXo + J12X1X2X0 + 
• ■ • + Jl...qXl ■ ■ ■ XqXo 

= xo{Jo + Jixi + . . . + JqXq + Ji2a;ia;2 + 

. . . + Jl,,,qXl . . .Xq) (7) 

< I Jo + JiXi + . . . + JqXq + Ji2a:^ia;2 + 

. . . -f Jl...qXl ...Xq\ 

— ao + aixi + . . . + aqXq + ai2a;ia;2 + 
... -I- ai...,a;i . . .Xq, 

where the bound again becomes an equality for the 
ground state energy. A new Hamiltonian is obtained 
which is reduced by one variable. Notice that the last 
two lines provide a unique system of 2'' linear equations, 
one for each assignment of the Xi — ±1, that determine 
the new bonds a in terms of the old bonds J. 
To solve the linear system, wc define 

.g(x) = \Jo + JlXl + ... + JqXq + J12X1X2 + 

■ ■ ■ + Jl...qXl ■ ■ -Xql, (8) 

and note that for any function g(x), x G {±1}'^, it is true 
that 

9 

{e} i=l 

= E^'(^)ri^^ (9) 

{e} i=l 

-^(1 -f eia;i + . . . + eqXq + tx^2X\X2 + 

{«^} 

... -I- eq^-Y^qXq-lXq -|- . . . + ..(.qX^—X q) , 
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where the sum extends over all 2^ permutations of e £ 
{±1}« and the relation Sa,b = (1 + a6)/2 for a, be {±1} 
was used to represent the Kronecker symbol. Comparison 
of Eq. ^ with the last two lines in Eq. ([7]) yields 

{£} 

for the new bonds connecting the remaining variables. 

In general, it is not useful to reduce the Hamiltonian 
in this way; after all, if all n spins are connected to each 
other, as for the Sherrington-Kirkpatrick model^, just 
the elimination of one spin- variable requires 0(2") opera- 
tions. Yet, there are common situations, in particular for 
lattices of finite dimensionality and sparse graphs, where 
the application of the previous results can be very useful: 
either in itself, in combination with heuristic techniques, 
or as the basis of approximation schemes. Of course, 
we may also be interested in the system's entropy, the 
magnetization, overlaps, etc, which can be be considered 
simultaneouslySt. 

Although the combinatorial effort in the preceding ex- 
pressions seems daunting in general, they possess a rich 
structure that relate them to other, well-studied subjects. 



For instance, we can rewrite Eq. ((T0|) as 

2^ — 1 

az,,....., = ^Y.9i{3})Wk,2''U) (11) 
j=o 

with 

p 

k = l + ^2*"-\ (12) 

where {j} is the binary encoding (on ±1) of the integer 
j. In particular, Wk.L{x) is the fcth Walsh function^ of 
support L familiar from wavelet analysis and signal fil- 
tering. The orthogonality properties of Walsh functions 
provide a powerful means to analyze the preceding reduc- 
tion equations for particular choices of initial bond distri- 
butions. For instance, there may be types of graphs with 
a nontrivial bond distribution for which the reductions 
could be simple. Also, a transformation may be found 
that maps the distribution of the J's into that of the a's. 
Finally, existing, highly optimized wavelet algorithms^ 
may in fact produce efficient spin glass solvers based on 
these reduction equations. 
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